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I. INTRODUCTION 


A. BACKGROUND 


For more than two decades, the need to solve control 
problems in aerospace application has been the primary 
driving force behind the modern control theory development. 
Problems in manoeuvring, guidance and tracking of aircrafts 
and space vehicles have motivated the development of various 
control design and synthesis methods. One of the methods, 
the so-called Lineat se (Quadratic Control GE A 2EQ-controk 
[Refs. 1,2] has been widely used and is treated extensively 
in the control literatures. Unlike most classical methods 
where the design are based on conventional time response 
criteria, the LQ theory treats the problem of designing 
eontrollers as that of «minimizing. a quadratic cost, function 
Gtestates and control inputs: The design problems become 
that of selecting suitable weighting matrices in the 
performance index. Two questions naturally arise from this 
method. First, how does one select the weighting matrices 
and second, once a set weighting matrices is selected, how 
does one know that it is a good design. There are generally 
two approaches to the first problem; the obvious one is to 


rely on physical arguments and a certain amount of trial and 


Error (Refs. 3,4] Unfortunately, .such. formulatiom can: be 
obtained in only a few cases. Reference 4 provides a few 
guidelines that can be employed. The second approach is to 


avoid the physical aspect of the performance index but 
instead try to relate the weighting matrices with some other 
performance specification. For example, Tyler and Tuteur 
PRef. 5] expressed the characteristic polynomial ©as an 


explicit function of the weighting matrices for single input 


Lt 


single output CSirSO}) system with diagonal weighting 
elements. Root-Locus type of procedure were used to show 
how the variation in weighting elements affect the eigenva- 
lues of the closed-loop’ system. Similar relations were 
explored in [Refs. 6,7] in which more general expressions 
were obtained. Their uses were restricted to single input 
case’ due to difficulty in “handling polynomial” matrreca 
Solheim [Ref. 8] later developed a sequential design proce- 
dure based on diagonalized (decoupled) system. More recent 
results of eigenvalue placement in optimal control problem 
areprésénted AnV[REfs: 9 SL0,;T1 121. 

The second issue of LQ deSign, i.é., whether “a goed 
design has been obtained once the performance index has been 
fixed, is related to the multivariable nature of system: 
Unlike the single input case where the closed-loop eigenva- 
lues uniquely define the feedback gain and hence the 
weighting matrices, the MIMO structure provides additional 
dimension which allows further tradeoff for properties other 
than the closed-loop eigenvalue location. An example is the 
gain and phase margin, Or in MEMO case, the so-called 
robustness criteria. Robust-control has been the subject of 
extensive researches in recent years and results relating to 
optimal. control can be’“found tin [TRefs.. Tact. isi. 

It becomes evident from the above discussion that LQ 
control design and synthesis are not just a matter of speci- 
fying performance index. Optimal in the sense of satisfying 
performance index and perhaps pole location does not neces- 
Sary means that a good design has’ been obtained. Other 
criteria like disturbance rejection, robustness and sensi- 
tivity need to be considered and incorporated in the design 
procedure. This is the motivation behind our present 
research which in turn leads to the development of the 
Synthesis package. An overview of the thesis is described 


in the next section. 


eZ 


B. OVERVIEW 


In this section an overview of the thesis is given. A 
background of multivariable optimal control theory in terms 
of its structure, frequency domain characteristic and asymp- 
EQEZeC properties, is first discussed together with derivation 
of some useful relationships in Chapter 2. General robust- 
ness concepts and its application in Linear Quadratic (LQ) 
Control is presented in Chapter 3. In Chapter 4, a computer 
aided design package for pole-placement synthesis based on 
numerical optimization technique is presented. This package 
provides a useful computational tool to support the material 
in the remaining chapter. A step-by-step pole-placement 
synthesis procedure is also presented to illustrate how the 
package can be used to design optimal control system that 
meet time response criteria and other properties. The use of 
the pole-placement synthesis package in two actual design 
problems is demonstrated in Chapter 5. Results in ‘terms of 
frequency and time response properties ,robustness (Singular 
value decomposition) are compared to those obtained by other 
design methods. Program listings and an example of a design 


session are included in the Appendix. 
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II. MULTIVARIABLE LINEAR QUADRATIC CONTROL 


In this Chapter a brief review of Multivariable Linear 
Quadratic Control theory is presented. Structure of #0 
system is first given, general stability properties are then 
discussed. In section two the general pole assignment 
problem is formulated for the MIMO state feedback system. 
Interpretation of the state and control input -werpgitame 
matrices and their effect on the closed-loop time response 


behaviors and the asymptotic properties are presented. 


A. LINEAR QUADRATIC SYSTEM 


Consider the following linear time-invariant state-space 


system given by the equations: 


x(t) 


Ax.(t.). +, Bul(t) (eqn. 2a) 


y(t) Cxe) (eqn 2°23 


where x(t) is the n-dimensional state vector, u(t) is the 


m-dimensional control vector and y(t) is the p-dimensional 


output vector. A ,B and C are real constant matrices of 
dimension nxn, nxm and pxn respectively. Assuming that they - 
form a controllable parr(A,B) and an observable pair(A,C), 


the optimal feedback control law is obtained by minimizing 


the following quadratic performance index. 
foe) 
PS J ( x! Q sc heyey ar GR u)dt (eqn, 2.539) 
0 


Where Ris positive definite (R>O) for bounded input and pe 


isi ia Secadlar. Q is a semi-positive definite matrix (Q200r 
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When both Q and R are diagonal matrices, 0 defines the 
relative weight between the state and control weighting 
matrices in the performance index. The quadratic form x!Qx 
and u!Ru provide a weighted measure of the magnitude of the 
states and control vector respectively. The steady state 


eontrol law that minimizes J is given by, 


mot) = -Fx(t) (eqn, 224) 


where F is the feedback gain matrix which is given by 
= 
t= -kR B P (eqn 2.5) 
The positive definite matrix P is given by the solution to 


the steady state Riccati equation. 


Bae A'P 2 O2-—PBR BP = 0 (eqn 2.6) 


Equation 2.5 and 2.6 are well-known results in optimal 


control theory that yield the optimal closed-loop system 


x(t) = [A + BF]x(t) (eqn 2.7) 


whose closed-loop poles are given by the eigenvalues of the 
matrix [A+BF]. The LQ system given by equations 2.1 through 
2.6 is closed-loop stable and can be represented by the 
feedback configuration in both the time and frequency domain 


as shown in Figure 2.1 


ibs 


Frequency Domain 


Time Domain 


Figure 2.1 State Feedback System-Time and Frequency Domain. 
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In Figure 2.1, if the loop is broken at the input (X) as 


shown, the lloop transfer function is given by 


Gis) = F(sr -{A) B (eqn 2.8) 


The matrix [I + G(s)] is’ called the Return Difference Matrix 
and will be shown to have some important feedback properties 


in the following section. 


B. POLE ASSIGNMENT PROBLEM 


In the most’ general form, the state feedback pole 
assignment problem in control system design can. be formu- 


lated precisely as follows: 


"Given Leal matrices (A,B) of order (nxn,.inxm) xrespec- 
tavely and a set of n complex numbers (1,,A,,,... A, ) closed 
under complex conjugation. Find a real mxn jmatrix.F, such 
Maat the eigenvalues of [A+BF] areA,. , i = Ly 2y3e0e me’ 


In general, the closed-loop eigenvalues of (A+BF) can be 
aebatrary, Jlocated-in «the “complex plane, with the only 
restriction that complex characteristic eigenvalues’ must 
occur in complex conjugate pair. in other: ;wordsi;, cis the 
Matacices,,({A,B)). are’ a completely controllable pair, the 
stability of the system can always be improved by state 
feedback. If the (A,B) pair is not completely controllable, 
then the system is required to be ‘'stabilizeable' meaning 
Ematoan its controlability canonical form given by equation 
2.9 below, the matrix Ay, is asymptotically stable or any 
unstable subspace of equation 2.08 CLs also sim the 


controllable subspace. 
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Xa (t) 0 —Anl | x, (Ce) Vo aeice 
(eqn 2.9) 


The solution to the pole assignment problem in the 
single input (m=l1) case, when it exits, can be shown to be 
unique. In the multiple input case (l<m<n), the solution of 
the so-called inverse eigenvalue problem is, in general, 
undetermined with many degrees of freedom. Additional 
conditions must be supplied in order to eliminate the extra 
degrees of freedom. This has been an area of active 
research in recent years anda number of approaches have 
been developed to relate the extra degrees of freedom with 
properties such as system eigenvectors, transmission zeros 
and; robustness ,[Rets,) 16.0712 In this work, it “rs 'shogm 
that Linear Quadratic formulation incorporating equation 2-34 
will partly remove the uncertainty that exists in the 
multiple inputs case. It will be shown that useful proper- 
ties like robustness are guaranteed. It Ws also shown thar 
the LQ type of pole placement formulation, when combined 
with eigenvectors assignment type of formulation, will 
produce some very useful design and synthesis procedures. 
In the present work, however, only the LQ eigenvalue place- 
ment problem is addressed; the problem of combined eigen- 
value and eigenvector assignment is briefly described in 
Chapter 5’. 
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C. WEIGHTING MATRICES AND SYSTEM PERFORMANCES 


This section briefly reviews the effect of weighting 
matrices on system performance. The physical aspects of the 
weighting matrix for both single and multiple input systems 
are presented first together with some discussion on the 
asymptotic behavior of the LQ system. 

It was shown in the last section that under complete 
controllable conditions, the time-invariant linear system 
can be stabilized by a linear feedback control law. For the 
regulator-type problem where the aim is to bring the system 
from an arbitrary initial state to the zero state, the 
closed loop poles can be chosen far to the left on the 
complex plane. Convergence to the zero state is fast but 
the large input required may not be practical. This natu- 
rally leads to an optimization problem where’ the trade off 
is between speed of convergence to zero and the magnitude of 
the input. This is reflected in the two quadratic,.terms in 
the performance index. The quantity x'Qx in the first term 
of the performance index is a measure of the extent in which 
the state at time t deviates from the zero state. The 
matrix Q determines how much weight is attached to each of 
the component of the state. The integral J(xTQx)dt is a 
erateria for the cumulative deviation of x(t) from the zero 
State during the interval. 

The problem of large control input is resolved by 
incooperating the second quadratic term, JS(uTRu)dt. Larger 
Beurue in the element of the control weighting matrix R will 
Besuat in smaller input. It will be shown later that one can 
manipulate R to achieve some secondary design objectives. 
The remaining parameter p , that need to be’ specified, 
accounts for the relative weighting between the state and 
mie control inputs. Selecting optimal value for p depends 


on the particular problem and the design requirement. As p 


Lg 


decreases, the integrated square regulating error decreases 
but the integrated square input increases. Very often, the 
optimal control problem is solved for many different values 
of ge) < A graph’ similar to-that° shown in fleuse 2c 
obtained where the integrated square regulating error is 
plotted versus the integrated square input. An appropriate 
value of p is then selected to give sufficiently small 


regulator error without excessively large input. 


? increasing 
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Integrated Regulator Error 


Preare.2 32 Selecting Relative Weighting Parameter p. 
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The special case where p approaches zero ,the so-called 
asymptotic properties, has been shown to provide’ good 
insight for LQ control system design. Some of the results 
from [Refs. 4,18] are summarized below. 

As p decreases to zero for the system given by equa- 
Evons 2...) through ab2 <6, ¥csomeo(4s'ay q -) of the closed-loop 
poles go to infinity while other ( n-q ) stay finite. Those 
remaining finite approach the left half plane zero of 
det[B*(-sI-A")~'Q (sI-A) |B]. If mis the dimension of the 
input vector, then at least m closed-loop poles approaches 
LAtinity. Abi—elosed=-loop*poles that go to infinity do so 
by grouping into several Butterworth patterns of different 
order and radii. fou, p approaching: infinity, the closed- 
loop poles approach the mirror image of the plant open-loop 
poles. To illustrate the asymptotic concept, two examples 
from [Ref. 4] are given below. 

An example of the asymptotic properties of a_ single 
input system is shown in Figure 2.3 . The closed-loop poles 
of a position control system using LQ type feedback are 
protted as a function of/p . The system has two open-loop 
poles at -4.6 and 0.0... As p decreases, the closed-loop 
potes go to infinity along two straight lines that make an 
angle of mG waithy the negative “real. axis. AS Pp 
approaches infinity, both closed-loop poles first meet on 
the negative real axis and then approach the open-loop 
Peles at (-4.6, 0). 

Figure 2.4 shows the asymptotic loci of the closed-loop 
poles for a multiple input system where n=4 and m=2. There 
are four open-loop poles at (-0.006123, +j0.09353) and 
fe 50, 2+41.394) and both the state and -control weighting 


Miaenices are taken to be of a diagonal form. AS Pp 
approaches to zero, one closed-loop pole stay finite at 
sO O82 . ihesremaining three pos torintinity, two of which 


assume a second order Butterworth pattern and the last one 


Zt 


approaches on the negative real axis. When p approaches 
imfing ty, all closed-loop poles approach the open-loop 
poles. 

Many researchers have explored this asymptotic proper- 
ties. Stein [Refs. 9,10] developed a procedure to select 
the control weighting matrices for a desired closed-loop 
asymptotic eigenstructure. It will be shown in the subseq- 
uent Chapters that the asymptotic properties provide useful 


guideline for the design procedures to be described. 


9 =0.00002 


9 =00002 


9 =0 00002 


Figure 2.3 Single Input Asymptotic Root Loci. 


pa 7) 


Faraway Poles 


Nearby Poles 


Figure 2.4 Multiple, Input Asymptotic Root Loci. 
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III. ROBUSTNESS THEORY AND LINEAR QUADRATIC CONTROL 


In the last Chapter, the effect of weighting matrices on 
the closed-loop pole of the LQ system was discussed. This 
Chapter addresses yet another important feedback property 
that contro] system designers are concerned with: 
Robustness. Robustness theory was developed when it was 
realized that the classical single loop Nyquist test was not 
adequate to guarantee stability when the multivariable open 
loop plant deviates from its model due to a variety aie. 
reasons [Ref.. 15]. In the following section , the concept 
of robust design for both SISO and MIMO general feedback 
system is reviewed. The Singular value analysis is 
discussed in term of multiplicative type of disturbaneese 
Finally, robustness for linear quadratic state feedback are 
presented in terms of the effect of weighting matrices on 


the singular value curve. 


A. ROBUSTNESS CONCEPTS 


The concept of robustness for SISO .system can | bestepe 
described in terms of the definition of phase and gain 
margin. A system characterized by good gain and _ phase 
margin implies that changes in the plant model parameters 
and changes in the loop gain and/or phase may be accommo- 
dated without loss of stability. The gain and phase maremns 
of a SISO system are defined with reference to the perturbed 
SYSteM In Figure 3k 

Assuming that the unperturbed system (1(jw)=1) is 
stable, the positive (or negative) phase margin is the value 
of @» greater (or less) than zero at which the perturbed 


system with l(jw) = k*exp(j@) becomes unstable. The upward 
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Figure 3.1 The Perturbed SISO System. 


(or downward) gain margin is the smallest (or greatest) 
Value of 1(jw)=k=constant, for which the system become 
unstable. With reference to the classical Nyquist plot in 
Figure 3.2 , gain and phase margin are defined as, 

co f (upward) = 1/k, GM | (downward) = 1/k, 

EM ha a ey PMpsta ta, ‘ 
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A set of minimum guaranteed GM and PM may be obtained by 


defining ®%= min[l + g(jw)] as shown in Figure 3.3 where, 


and 


_ 


Figure 3.2 The Nyquist Plot - Gain and Phase Margin. 
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Note that in the above definition of GM and PM, either 
Or | is allowed to change in the loop. The allowed 
changes are therefore very restrictive. A more useful defi- 
nition of the gain and phase margin for MIMO system that 
accounts for simultaneous changes in both ®, and/or K; (the 
so-called universal gain and phase margin) has been derived 
mae pret. 19], From Figure 3.3 it can be seen that a may 
provide a rather conservative estimate of the actual gain 


and phase margin. 


Figure 3...3 The Minimum Guaranteed GM and PM. 


2, 


In MIMO system, gain and phase margin characterize the 
ability of the system to tolerate gain and/or phase changes 
within all loops’ simultaneously. Figure 3.4 shows a 


perturbed MIMO system with the assumption that L(jw) = Dia(l, 


jw), Law). sem) As in the SISO ‘case, the system wage 
remain stable as longer as 1; (jw) satisfy GM | <) ees eval 
(assuming that @s) are’ ‘zero’ )). For the case when the 
magnitude of 1(jw) are constant, the system will remain 


stable for all @-s that satisfy PMo< ©.< PM 


Figure 3.4 The Perturbed MIMO System. 
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The set of minimum guaranteed multivariable gain and 
phase margins are determined by the minimum singular value 
(co ) of the return difference matrix [I + G(s)], where G(s) 
is the open, loop transfersmatrix and consists of the plant 
and its controller. Note the similarity between the SISO 
and MIMO cases, 


ef Nearnesswot) (in+ g(s)) to the origin. 


ckenearnesstot) matrix [ls Gs )] to singularity. 


Two important results that are related to multivariable 
phase and gain margin developed in [Ref. 15] are next 
presented as a theorem. 


THEOREM: The multiplicative perturbed system (Figure 
3.4)\/is stable if either of the following conditions hold: 


aan 
Qq 


coir beta Hite eo[uasds) fhe] (eqn 3.1) 


Nh 
Q 


Ole +8GN(s)ih 21 © [be(s)eshr] (eqn 3.2) 


Where «, o denote the maximum and minimum singular values - 
of [I+G(s)] respectively. 


It will be shown that condition 1 can be related to the 
epramality condition of LQ system and hence provides a 


useful relationship between the weighting matrices and 
robustness. 
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B. ROBUSTNESS IN LQ SYSTEM 


Robustness properties pertaining to LQ “system Vvare 
closely related tto the frequency domain optimality condi- 
tion. For the SISO\case,; Kalman [Ref. 1] showed that the 


return difference transfer function satisfies the inequality 


CA Few) 9 cert Seer a (eqn 3.3) 


Inspection of the Nyquist diagram in Figure 3.5 clearly 
indicates that a SISO LQ state feedback has a guaranteed 
infinite upward gain margin , 0.5 downward gain margin and a 


minimum phase margin of + 60 deg. 


Fieurce 3.5 SISO LQ Nyquist. 
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In a similar manner, multivariable stability margin can 
be derived from the multivariable version of condition 1 in 


equation 3.1 ; 
[I + G(s] Ra Pt +G.Cs)). SyR | (eqn 3.4) 


where 


1 


Lp pst -° al B 


Giés)'= Rr 
and P > 0 satisfies the steady state Riccati equation. 

It can be shown that condition 1 in equation 3.1 above 
can be written as 


at, + rn‘? (jw) wa Dealt (eqrie3 55) 


which can be reduced to 


emit + 6 (aw) > 1 Geqn 133.16") 
Pace Rat sw dtaponal 6() 1.6. .R \e pp dyevlor rsome #"positive 
Sealar e). Luce the SISO: case, the multivariable LQ regu- 


lator with loop transfer matrix G(s) that satisfies equation 
Seowand, 3.6 has, in all the feedback loops, a guaranteed 


minimum gain and phase margin given by, 
cmt = 1/2, and PM = +60 .deg 


The case when Ry as mot) diaponal’ is interesting _ as 
condition 3.6 no longer apply and additional trade-off can 
be obtained by including off diagonal terms in the control 
input weighting matrix. This is especially useful when the 
nature and structure of the disturbances are known. Design 
povolivine |) the “off diagonal R matrix will be shown in 


Appendix A. 
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IV. DESIGN PROCEDURE 


A. GENERAL 


The background material described in Chapter 2 and 3 are 
the basis for developing a computer aided design package and 
the corresponding design procedure. The design philosophy 
presented in this Chapter is most useful when a designer is 
able to characterize the desired system in terms of closed- 
loop eigenvalues and time response. Some initial physical 
insight of the weighting matrices ,their asymptotic proper- 
ties and the nature of the perturbation will be useful in 
the design process. This Chapter begins with a discussiom 
of the various approaches to the LQ pole placement problem. 
The selected approach and the corresponding computer aided 
design package is presented. The design philosophy and 
design procedure for both the reduced order and full order 


model are then given. 


B. APPROACHES 


All the pole placement algorithms for LQ system that 
have been developed so far require an expression that relate 
the characteristic equation of the optimal system «with te 
elements of the weighting matrices. Two such formulations 
for the stabilizeable and detectable time-invariant linear 


system (equation 2.1) and the quadratic criteria (equation 


2.3) are given by 


#(s)#(-s) = ¢(s)¢(-s)det[I + R!H(-s) QH(s)] (eqn 4.1) 


and 
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e(s) eC ~s’) es dat ITs oR a ¢-s) GaGa (eqn 4.2) 


where %(s) = detisl oA +BF land o(s)yu0> deti[si -! A] are 
the closed-loop and open-loop characteristic polynomials 
respectively. H¢s) y= C(sI-A) |B is the open loop transfer 
matrix of the system. 

Both formulations have been used in root-locus’ type of 
procedure to investigate how the closed-loop poles move as 
weighting matrices changes. [Refs. 5,6]. For ™MIMO> case} 
there has been little success due to problems’ involving 
polynomial matrices. In this work, a different approach is 
adopted. Equation 4. lior 4224is formulated sas %a-numerical 
optimization problem in which the objective function is made 


equal to the determinant part of equation 4.1 or 4.2 


Bey = det + RH (s), O H(s)J ( sein nelah) 
or 
-_-+ — + 
Sagt-Mdet[T s*1/,R°°H (-s) Q H(s)R J (eqn 4.4) 
fora’ piven’ desired closed loop pole s = Sa.>o,,eduation 


4.3 or 4.4 becomes 
$ (Sq eC sa y= 0 (eqn 4.5) 


meGvedine that (sj, )?%(-s, ) is not equal to.zero, the 
Objective function must equal to zero if the particular Q, R 
mc slsecO, 'Correspond to the desired closed-loop poles. 
Bomverrence to zero for a. given set of Q and R'is therefor 
automatically guaranteed. 

The pole placement problem can therefore be solved as an 
unconstrained multivariable Optimization <in which the 


emements of Qand R are varied to make the objective 
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function in equation 4.3 and 4.4 approach zero. This was 
done during the early phase of the work. It was later 
discovered that more insight to the problem can be obtained 
by first transforming the problem’ to an appropriate cooras=. 
nate system and then to perform pole placement one at a time 

This is of advantage as a system designer is often satis- 
fied with several open-loop poles in a large system. 
Reassigning poles in the the reduced-order model will reduce 
computer time and memory requirement. 


The optimization routine selected for this work is the 


so-called SUMT method (Sequential Unconstrainted 
Minimization Techniques ) obtained from the ADS package in 
(Reis « 720.524). In this method, the objective functrom 


(eg. equation 4.3 or 4.4.) and any constraint equation are 
formulated into an augmented objective function in which the 


problem is solved as an unconstraint optimization task. 


C. POLE PLACEMENT ALGORITHMS 


For ease of implementation and better insight, only the 
problem of determining the state weighting matrix Q (given 
R) that gives a set of closed-loop eigenvalues is consid- 
ered. It must be emphasised that the algorithm can also be 
formulated to determine R (for a given Q) or to vary @ anda 
at the same time. In most cases, the present formulation is 
adequate as designers usually have some knowledge about the 
control weighting matrix. System matrix that has real and 
distinct eigenvalues is presented first, follows by cases 


where A has complex eigenvalues and repeated eigenvalues. 
1. System with Real and Distinct Eigenvalues 


The original system given by equation 2.1 and 2.2 is 
first transformed into a diagonal form using the 


transformation given by; 
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Cte = Mz(t) (eqn 4.6) 


where M is an eigenvector matrix corresponding to the system 
matrix A. ana z(t) “~is’ the’ new state vector. The trans- 


formed system in the new coordinate is given by, 

- -I| 

Btepr= APZ(t)P+-M Bult) (eqn 4.7) 
Siete Ao is a diagonal matrix dia[4,, 4, ,4,;,.:. ] 


The performance index (equation 2.3), when expressed 


in terms of the new state vector z(t) becomes, 


qq 
! 


oni x’Qx + u'Ru ) dt 


-@ 
Jy (2M "QM z+ u’ Ru) dt 


a Tees %: 
J, (izeoz, +.u RK ut) dt (eqn 4.8) 


pe T 
where Q = M QM. 

Tt sean’ be shawn that to “move an open-loop pole to 
mesenewilocation given by s;= sj, , only oe is required and 
other Qs' have no effect on the pole assignment. AS an 
example, to move the open-loop’ pole at s =A 4 £0f 
PemotapA,, Nn, %,% =...) = to its new location s=), , only 
Q= dia[0, 4,, 0, ...] is required. : 

Q ean then be selected according to equation 4.3 or 
4.4 using the optimization routine. As currently imple- 
mented in the program, there is no constraint equation 
formulation. Once the value of Q that satisfies the desired 
pole location is obtained, the system is transformed back to 


the original coordinate system via, 


=i al 


Se-ot1eQM (eqn 4.9) 


a0 


With Q known, and R given, the optimal feedback gain F can 
be obtained by solving the steady state Riccati equation as 
given in equation 275° and 226 7 esimees the pole placement is 
done in the decoupled coordinate system, only the eigenva- 
lues that correspond to Q, is reassigned; all other eigenva- 
lues remain unchange. It can be. also shown thatwwene 
elgenvector corresponding to an eigenvalue is also unchange, 
this property will be shown to be useful in the reduced 
order formulation of the linear quadratic problem. 

If desired, the problem here can also be formulated 
to move more than one eigenvalues in one run. This ‘can! be 
done by modifying the objective function to include more 


terms as follows; 


‘obj = S derfre Rw (-syonejn (eqn'4 fiom 


where n is the number of poles to be reassigned. 

The augmented matrix Agyg = [A +) BF]= is egehen 
computed. If desired, the procedure may be repeated to move 
other open loop eigenvalue to its specified position using 
the new Agug as the starting, plant inate: This:(wrbeae 
turn result in another set of ,0 . and Jhee The effectives@s 


and F, after n reassignments are given by 


Oe gay toe ea Oe (eqn 4.11) 


Bes Sy tea ae ten (eqn 4.12) 


The above pole assignment procedure can also _ be applied to 
an optimal system where an initial starting Q and R are 
given. A good example is when the control system designer 
has some knowledge of the weighting matrix but would also 


like to meet a specific time response requirement. 
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2. System with Complex Eigenvalues 


If the same similarity transformation mentioned in 
tne last section is used’, the transformation matrix will be 
complex. To be able to work with real matrix, an auxiliary 


transformation of the form given by equation 4.13 is used; 
mt) (=) Tz (t) (eqn 4.13) 


T = ML and M is the eigenvector matrix (equation 4.6) The 


matrix Lis given by, 


Os 0", og, (00.4... 0.0 
O5 O37 OC 
L = 0:.:0 0.0 1G 
; 1.0 
0.0 PO 
(eqn 4.14) 
The transformed system is then given by, 
mee), =A 2(t).* T Bu(t) (eqn 4.15) 
with performance index , 
J = erm Tz + u Ru yed& (eqn 4.16) 


a A 
where Q is now given by Q = Ts ON ie 


a7 


It can be shown that to move a ~pairgot Meompmes 


eigenvalues given by s = a + bj, a weighting matrix of the 
form 
0 0 Oh: 0 
A ° q, v 
Cem A 0 dig 
0 
0 0 
(eqn 4.17) 
with q: - qs is required. 
In a similar manner, 0 can be obtained by using the 
optimization routine, with the condition d; =a formulated 
aS a constrained equation. Inverse transformation and 


determination of Q, and F,are ‘identical to the dastaiaiee 


eigenvalue case with M in equation 4.9 replaced by T. 
3. System With Repeated Eigenvalues 


In this case, the system matrix cannot be diagonal- 
ized but the general procedure given above still apply. The 
system is first transformed into the Jordan canonical fornmwe 


ee AU (eqn 4.18) 


where U is a transformation matrix which is not the eigen- 


vector matrix  M. An example of the Jordan form is given 
below, 
r i: 0 7 
Ja = 10 r 
0 0 r 
(eqn 4.19) 
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The only difference with the two procedures mentioned above 
is that the pole reassignment has’ to begin at the bottom of 
each Jordan block. For example, in the system given above 
Cequataon 4.19); the first re-assignment Willeresule (in ta 


new system given by equation 4.20 


(eqn 4.20) 


Determination of Q andF using the optimization and the 
inverse transformation routines. -are, identical to the 


distinct eigenvalues case with M in equation 4.9 replaced by 
i. 


Pe COMPUTER PROGRAM DESCRIPTION 


The computer aided design package developed in this 
Emesis is illustrated in Figure 4.1 The program is devel- 
oped using the top-down approach with special purpose 
subroutines called by the main control program. The driver 
program supports three independent modes with the data entry 
portion common to all modes: 

ime eData Entry : The system matrices A, B, C and/or F, Q, 
R etc are entered through a data file. Design vari- 
ables such as desired poles locations, elements of 
matrices to be varied etc, are also specified through 
the-input data. file. 

ma role Placement Mode ; .-iIn this: mode, an arbitrary ‘set 
of closed-loop eigenvalues is assigned by selecting 
the appropriate state weighting matrix. As shown in 


Figure 4.1, the transformation matrices for various 


3.9 


Cases are Computed | fursste The pole placement is 
achieved using the numerical optimization routine 
described in the last section; Q is obtained and then 
inverse-transformed to the, orieinal co-ordinate 
system. If desired, the results can be used as an 
input to the Linear Quadratic Control Program. 

3. Linear Quadratic Control Mode :-This part of Meme 
program is adopted from the OPTSYS program. Given a 
set of weighting matrices Q and R andthe system 
matrices A, B andC, it computes’ the steady state 
feedback gain F, closed-loop eigenvalues, etc. 

4. Singular Value Analysis Mode : This portion of time 
program allows the designer to analyze various 
designs obtained from the two modes mentioned above 
in term of singular value vs frequency plot. The 
main part of this program is adopted from [Reft.-=221e 

The three modes of operation mentioned above may be used 
in any order to implement specific design objectives. A 
typical design process will involve runs alternating between 
the three modes until a compromise between primary and 
secondary design objectives is achieved. Record. of $ma 
typical design run together with a complete listing of the 
main program and their non-standard subroutine are given in 


Appendix B and C. 


E. DESIGN PHILOSOPHY 


The Linear Quadratic constant state feedback design 
philosophy for the linear time-invariant model is” /#ilws-— 
trated in Figure.4.2. It assumes that the location) [oteeee 


eigenvalues and system time response are the main design 


objectives. These objectives can be achieved using the pole 
placement procedure developed in this thesis. Single or 
multiple reassignment can be made in one run. A number of 
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DATA ENTRY 


TRANSFORMATION __ | EIGENVECTOR 
OF COORDINATE M,T,U ASSIGNMENT 


EIGENVALUES PLACEMENT 
GOMPUDEY Q),0 "RY 


BACK- TRANSFORMATION 
TO ORIGINAL CO-ORDINATE _ 


| 


COMPUTE FEEDBACK GAIN F 
(OPTSYS S ROUTINE) 


ROBUSTNESS ANALYSIS 
SINGULAR VALUE PLOTS 


| TIME SIMULATION | 
FOLE=ZERO MAPS ETC | 


Figure 4.1 Computer Aided Design Package Organization. 
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designs can then be obtained using different starting 


control weighting matrices, different state weighting 
matrices and different assignment sequences. Physical 
constraints such as control input amplitude, control input 


energy as well as general system properties such as asymp- 
totic behavior are heavily relied upon during this process. 
After the major objectives are satisfactorily achtevede 
secondary design objectives are considered. These include 
feedback gain reduction (by increasing the control weighting 
matrix), robustness (in terms of minimization of system 
sensitivity to modelling errors and/or parameter varia- 
tions), zeros locations, eigenvectors assignments. The 
extra degrees of freedom available in the MIMO state feed- 
back system can often provide a means to improve’ these 
secondary objectives while only slightly modifying the 


closed-loop pole assignment and thus the time response. 
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EIGENVALUE AND TIME 
RESPONSE REQUIREMENTSS 


PHYSICAL ARGUMENTS, 


ASYMPTOTIC, PROPERTIES 


POLE ASSIGNMENT AND/OR 


EIGENVECTOR ASSIGNMENT TO 
DETERMINE Qs AND Fs 


FEEDBACK ROBUSTNESS MODE EME 
GAIN REDUCTION] | SENSITIVITIES DECOUPLING RESPONSE 
REDUCTION EIGENVECTOR} |SIMULATION 


Figure 4.2 LQ Eigenvalue Assignment Philosophy. 
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V. DESIGN EXAMPLES 


The design procedure described in Chapter 4 is illus- 
trated in this Chapter by two design problems. A typical LQ 
structure and its properties, together with the pole place- 
ment procedure is first presented with a 2x2 model. A prac- 
tical design problem is then presented for the highly 
coupled lateral channels” of a CH-47 Heltvcopte:: The 
resulting LQ designs are compared with other multivariable 
state feedback designs® ‘[Refs2-22 2312 Tt is shown thae 
the procedure developed here is a viable tool for robust 


constant feedback controller design. 


A. INTRODUCTORY 2X2 PROBLEM 


This problem formulated in reference 23 serves to demon- 
strate how a highly cross-coupled multivariable control 
problem can be formulated and solved as a linear quadratic 
design problem, using the pole placement procedure. The 
problem provides excellent insight into the structure of the 
multivariable LQ system and its built-in  .robustnesis3ue 
cross-coupled ‘perturbation. 

Figure 5.1 shows a diagram of this basie’ 2X2 systemmaam 


which the plant is given by 


x(t) = Ax(t) + Bu(t) (eqn 5.1) 
y(t) = Cx(t) (eqn 5.2) 
where 
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A = B= 
0 -1 0 1 
a 0 

Ce = 
0 sl 


FLpune’S A Simple 2X2 MIMO Model. 
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This system has open-loop eigenvalue at -l, - and ais 
therefore stable. The b,, term in the control matrix B is 
purposely made large to produce the cross-coupled effect 
from channel two to channel one( see Figure 5 ko The 
design requirement is to select a set of feedback gain F 
such that the closed-loop eigenvalues are at -2, =2. 
Assuming that this is the only requirement, 1 is notidiiiae 


cult to see that a unity feedback law of the form (Fig@re 
be re 2a) 


+ 


(eqn 5.3) 


will produce the desired closed-loop system given by, 


7 [ ] 
xX, So, LO) x : 50 Oey 


x 0 -2 Xx ) 1 Uc 


ti 
(eqn 5.4) 


The above design seems to be acceptable as far as eigen- 
values or time response is concerned. It is now shown Ehae 


when robustness of the system is considered, the unity feed- 


back gain controller performs rather poorly. On _ the other 
hand, design using LQ Pole Placement type of formulation 
will result in robust controllers. To demonstrate the lack 
of robustness of the unity feedback design, the feedback 


gain matrix F as given in equation 5.4 is perturbed slightly 


(by +5%) and the eigenvalues of the resulting closed-loop 
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Bigure 5.2 Unity Feedback for the 2X2 Model. 


System matrix are calculated. The absolute and percentage 
errors in the eigenvalue due to the perturbation of the 


closed-loop system are given in Table I 


It can be seen from the above that the first cut design 
is very susceptible to model and feedback perturbation. A 
Se. Changes in the f,, term has resulted in a large shift 
( 160% ) in the closed-loop eigenvalue. Lack of robustness 
in the unity feedback design can also be seen in terms of 


the minimum singular value plot of the return difference 


matrix in the frequency domain. For the unity feedback gain 
Ssyocem Shown in Figure 5.2, the return difference matrix is 
given by, 


47 


TABLE 
PERTURBED EIGENVALUE FOR 2X2 MODEL 


Perturbation Absolute Changes Percent Changes 
ink 657 in Eigenvalues in Eigenvalues 
“En. aa ee O05") , ojos ee a.5 1, 200) 
£i2 0.0 = $0.0 0:0 , 2028 
£2 0.67 = +32265 38.5: t Nese0 
All Ly255%, 45.346 S725" 5 Lovee 
S$+2/ (sei) 50/s+1l 
I + G(s) = 
0 st 2/ sre 
ns 
(eqn 5.59) 
where G(s) =C(sroayr on is the loop transfer matrix as indae 


cated. in Fisure: 53 

The multivariable Nyquist diagram ( locus of det[{I+G(s)] 
for the system is shown in Figure 5.4 Tf this" diagraneers 
interpreted as for a single input system, the .(-1/2,©)) eae 
margin and (+160) phase margin would lead one to believe 
that the design is a good one . This has been shown to be 
not the case, a 5% perturbation in F would cause the system 
to become unstable. The above clearly demonstrate the 
inadequacy of the classical method in evaluating stability 
margin for MIMO system. 

Robustness properties of the unity feedback controller 


will now be analyzed in terms of singular value as discussed 
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Figure 5.3 Loop, [sanster yMatrixe- €Fe=vEi: 


aay Chapter. 3. The minimum singular value plot of [I+G(s)], 
Meamsniown in Figure 5.5 as a function of frequency. The lack 
of robustness is clearly indicated by tthe relative small 
Singular value at frequency around 2 rad/s. Using™ the 
universal phase and gain margin chart developed in 
eet. 19], the minimum singular value at this frequency 
Saeeesponds to. a gain margin of «(0.91, 120)» and’ a phase 
Maeein.of (+ 4 deg). 

Beats mow shown that formulation using: “LQ “approach -and 
the pole placement procedure developed here will result in 
robust design that meet the time response requirement. 
Parthermore, better insight of the design process can be 
Obtained from the procedure to be described here. The first 


Seep) in the LQ design is to determine the asymptotic 
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Figure 5.4 Multivariable Nyquist Plot. 


properties of the system, i.e. movement of closed-loop poles 
as RO. Using results from Chapter”® 2,° it “can be estan— 
lished that as R increase from 0 too, both closed-loop 
poles move from infinity on the real axis to the open-loop 
poles location. None of the closed-loop poles stay finite 


as R20 since the dimension of—the input control vector ads 


equal to the dimension of the state. Assuming that R = IGA 
the pole placement is accomplished in two steps. The “£2 
step is-to move: the open-loop pole at =f te" —2. 0. As the 


system matrix A given is already ‘in Jordan form, no trans= 
formation )is -requared): The pole placement program puts the 
pole at--139987,qwith, 


50 


SINGULAR VALUE PLOT 


LEGEND 
NY. 


= 
— 
= 
—_— 
ez ° 
—<— 
= 
=) 
& 
a 
v) 


10° aie 
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mrewnre 5.5 Singular Value Plots - Unity Feedback. 


owl 


0.00 Erg 0 0 0 


0 0 0:..01983 0 


and 
1.99 1S 0 
Ag ug 
0-01.98 3 1.0 
In the second step, the other open-loop pole at -l. is 
moved to -2.0 , using Agyg aS the new plant matrix. The 
resulting 0 and F and the augmented plant matrix become, 
-2.998 -149.9 0.9994 -49.978 
oe Es 
-149.9 799933 -0.00841 0). 42 1 
The effective Qe and Fe required to move’ both open- 
loop poles: at -1.0) to <2. ,~arenOs = Q, * Qs and FF... =(5me 
Fz as shown in equation 5.6 below: The pole placement 


procedure is completed with the final eigenvalues placed at 
(3199255... + 70305623). 


2.99919 =149°9 029994 -49.978 
ORS Bee 
=149,9°° 7499" 0.0114 0.4211 
(eqn 5.6) 


ao 


The, Sineular value plots,.of the., case where R.= I 
together with the unity feedback gain ( non-LQ design ) are 
shown in Figure 5.6 hey well! establisheds fact, that; .LQ 
design possesses ( 1/2,” ) gain margin and (#60deg) phase 
margin can also be readily observed from the same figure as 
ane minimum, sangular values of, [1+G], 2 , is greater than 
one for all frequency. Changes in closed-loop eigenvalue 
for a small perturbation in F is again computed as shown in 
Mable TL). (It can be’ Seen that. the LQ design is robust with 
the largest percentage change in eigenvalues location of 
only 10%, when compared with the 160% change in the unity 
feedback design. 


TABLE II 
PERTURBED EIGENVALUE FOR LQ DESIGN 


Perturbation Absolute Changes Percent Changes 
ask .i( +54) in Eigenvalues in Eigenvalues 
eet eee or ee on Tae tore 7 
ees eee. Heo eo. 186) Ys Cee uarheta taal 
meee t* |S of0592) 00578 | 1" 2890) |, BS © * 
Biaiper, =P |\° OereiePeo.a7o° yr gPoZeeIn  Gp.soet 


ines .pole-zeron plots .ofs:various_fclosed-loop. transfer 
functions of the closed-loop transfer matrix for both the 
unity feedback and LQ design are compared in Figure 5.7 and 
a — For the unity feedback design, zero at minus three 


Peethe input 2 to output 1 channel. corresponds to. the 
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Figure 5 56 Comparison-Singular Value Plots (2x2 model). 
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minimum singular value frequency ( point A in Figure 5.6). 
TE is in facet this zero that causes the the system to be 
sensitive to perturbation. For the LQ design, the built in 
robustness cause the zero at minus. three to move toward the 
pole location aty=2". 

Improvement in the robustness from LQ design is now 
analyzed in terms of Bode. plots. The open-loop’ gain and 


phase vs frequency plots for a MIMO system can be obtained 


from the open-loop transfer function matrix, G(s). For full 
state feedback, ceveneia EF (if the open-loop plots 
without feedback is considered, G(s)=C(sI-A) 'B ) The 
mateex) G 1S ja Matrix-valued rational function ‘of s, Tt 


describes how the system (with or w/o feedback) appears to 
its environment. it as. am external description of the 
System and is closely related to the zeros of the system. 
The open-loop Bode plots for the two designs are compared in 
mupares 5.9 to 5.11 As ba, =0, there is no coupling from 
enannel 1 to channel 2. All channels have a -20 dB/decade 
Slope at high frequency which is in agreement with earlier 
observation that each channels has’ one finite zero. It as 
interesting to note that the unity feedback and LQ design 


fesunt “in almost/-identical gain vs. frequency plots for 


aurect channels.(i.e.-—channel 1-1 and 2-2). Any classical 
Single loop type of analysis will not be able to detect any 
difference between the two designs. On the other’ hand, 


cross-coupling effect can be readily seen from the gain vs_ 
Eoequency plot.in-channel 2-1 (Figure 5.10). The unity 
feedback design is characterized by the rather large channel 
2-1 gain at low frequency. A very snall..perturbation- in 
channel one's parameter can change the system behavior 
considerably. This has been fullustrated earlier by 
perturbing the feedback gain. It can be seen from the 


figure that LQ design reduces the crossfeed gain by large 
amount. 


59 


| 
' 


| PoLES (Ait). 


| lyrRO (1701 ) 
il eeennneiennnenet EERE 


— | -----—— 


«2 To 1 ) ZERO “( 2° TO 2am 


————— 


Figure 5.7 


Closed-Loop Pole-Zero Plots (Unity eGamneeene 


56 


| POLES ( ALL) | PPaeROwC 4 Tort | 


1 3 
2 2 
i, 1 
0 0 
=] -1 
aS) 2 
-3 -3 


= 2). 1 A 6 en | Diamond = Sm am > 3 


| ZERO ( 2 TO @ ji | ZERO ( 2 To 2) 


Figure 5.8 Closed-Loop Pole-Zero Plots (LQ °Désign). 


By 


MAGNITUDE — DECIBELS 


Figure 1529 


20.0 


0.0 


-40.0 


OPEN LOOP GAIN 


Sin. Snia ib Sas ieaieiblaie, +e gc bre 


| 


10 


AG: 


ee re ae ee eS 


58 


10 


Sve okalevelela o)=letherrieniniels 


baie: 
FREQUENCY (RAD/S) 


TOOT O Ora teao GC Cae es 


Open-Loop Bode Plots Channel 1-1. 


OPEN LOOP GAIN 2-1 


nn 
a) 4 
= 
== 
O 
Sa 
a 

| 
= 
=) 
=) 
= 
Za 
O 
= 
= 


FL). C00" | 
FREQUENCY (RAD/S) 


BPiguxe 5.10 Open-Loop Bode Plots Channel 2-1. 


5 


OPEN LOOP GATNG2 = 


ieee a: LEGEND Ee 
ce eee 


80.0 


MAGNITUDE — DECIBELS 
0.0 2 


40:0 


eee sO 


FREQUENCY (RAD/S) 


LO: 


Fieure 5). 3a Open-Loop Bode Plots Channel 2-2. 


60 


B. A HELICOPTER DESIGN PROBLEM 


The design procedure described in Chapter 4 is further 
iiustrated an) this section by an actual design problem. A 
controller is designed using the Linear Quadratic Pole 
Placement approach for the lateral dynamic model of a CH-4/7 
helicopter. The resulting design is then compared to multi- 
variable state feedback controller given in [Ref. 23]. 

The highly coupled two inputs lateral axis model of the 
CH-47 helicopter is used as a full order system. The state 


mector x(t) and control “input vector u(t) are given by, 


i, = Vv =0 Y-axis ‘velocity (ft/sec) 

X2 = p = Roll rate (rad/sec) 

x3 = r= Yaw rate (rad/sec) 

Kut = P= Roblicangle (rad) 

u, = 6, = Yaw rate rotor deflection control (inches. ) 


ioe ROLL rate rotor deflection control (inches ..) 


The state variables and the body axes of the aircraft are 
maustrated in Figure 5.12 The yaw and roll rotor deflec- 
Bron control produce changes in the yaw rate, slide slip 
angle, roll rate and bank angle. Assuming full state feed- 


back, the A, B, and C system matrices are given by, 


aa ee | 1.420 -O715 399 


A = O01 =05.7 = 0707 0.0 
0.04 =0).'0'5 =07-0'5 OF 
ie dy. Oia 0. 
O tk 07.95 1 0 0 0 
B = 0.04 =i: 2517 Ch. = | 0 it 0 0 
34 020 0 0 1 0 
0...0 0 0 0 0 1 
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The open loop eigenvalues of this system are; 


S; = +0. 2065 
ep = -0).0503 
ae = = 1.0498 
ae = 21263 


The open-loop system is not stable and the time response 
fsishown in Figure 5.13 for zero input and an initial condi- 
tion of ¢(9 )=0.1 rad 

The design requirements are to satisfy specification in 
terms of the step input response of the roll attitude 
channel (oP? | 2 ,". Stability margin requirements are those 
Pawen by standard military specification. in» dRet.. 23] 
three designs were obtained to satisfy the desired time 
response performance specification. All three control laws 


are of the form given by, 
a(t) = -Fx(t) + h¢ (t) Ceqne5.7) 


The values of F andh are summaried in Table III. It was 
sriowm in’ [Ref. 23] that two of the designs (design 1 and 2 ) 
were extremely sensitive to model errors and perturbations. 
It is now shown that LQ formulation using the pole placement 
procedure developed here will result in robustness design 
and yet satisfy the conventional time response criteria. 

It is assumed that the closed-loop poles requirement are ~ 
the same as those obtained inthe AlphaTech's design 1. 
ete, 3-12.51, -9.652, -2.125,). The firstestep in the 
design is to establish some asymptotic properties of the 
eyscem. The dimension of the control input (2) is less than 
the dimension of the state(4). AS’ shown in. Chapter 2, this 
implies that at least two closed-loop poles approach minus 
Mm_itinsty in the complex plane when R-— OO. When R7O 


(meaning no control input allowed), the closed-loop poles 
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TABLE, TIT 
ALPHATECH’ DESIGNS (1; 2, AND: 3) 


Designs Feedback Gains (F) h 
isms 0 ONE 72, 6.2325) 20.6, 5595:wan | 0 595 
OF O24 -- 227-0 ) 0.368) -7)..99 aa pal), 
two Os = “154. 18. 3 142.0 142.0 
0.201 52 1h6592: 0.5189. le A7 -1.47 
three 0 0 23%. 5 0 
0 -4 0 -27 2) 


approach the open-loop poles or their mirror images if they 
are in the right hand plane. (ive: =0 520635 ,77=20:0503;, 
pe 04987 ,- and -2.12635). 

The next step in the design procedure is to select a 
Suitable starting control weighting matrix. Based on guide- 


line given in [Ref. 4] and assuming that u,,,, and u are 


2max 
Beene coed inch.” R.=-~I°-is selected for the initial design. 
(an the “present formulation p is not needed as only Q is 


varied to place the pole ). 


The sequence of the reassignment is determined next. At 
present there is no known established guideline for 
selecting the prefered sequence of moving the poles. Two 


extreme Sequences are considered as follows, 
A. Move the left most open-loop pole to the left most 
desired closed-loop pole etc. The reassignment 


sequence then become: 


iaaemove: polle at -2.1265 to =25.12 
Ze eomove pole at —-1.0483 to -12.51 
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3. move pole at -0.2065 ta) -9 652 
4. move pole at -070503 toy-2, 125 


B. Move the right most open-loop pole to the left most 
desired closed-loop pole etc. For the problem given, 


the reassignment sequence are 


move pole at +0. 2065) to W251 
move pole at,-0,0503 cto -2451 
move pole at -1.0498 to -9.652 
move. pole .at, -2.126 = torr-2,. 25 


FF wWNH Fe 


(close, so no move required) 

Using the pole placement program developed in this 
thesis, the corresponding Q and F for each of the reassign- 
ments are obtained and tabulated in Tables IV and V for the 
two cases selected (design LQ-A and LQ-B). It can be seen 
from the table that difference reassignment sequence results 
in different set of OQ. and Fe §: In general, once the 
matrix R and the n closed-loop poles are selected, there are 
n(n+1)/2 extra degrees of freedom available in Q. . This-aise 
verifies the well-known fact that the general solutions of Q 
and R for a given set of closed-loop eigenvalue are non- 
unique. The elements of the Q matrix obtained during each 
reassignment depends on the transformation matrix (M, L or 
U) and hence the eigenvectors that are used to construct 
them. The important of eigenvector type of assignment is 
evident as Q, F and the resulting closed-loop poles depend 
on the eigenvectors used. The designer can _ shape the 
design by choosing appropriate eigenvectors for the trans- 
formation matrix. The application of these extra degrees of 
freedom will be discussed in the following section. The 
resulting designs (LQ-A and LQ-B) are now compared with the 
first design: in (Ref. 237]. 
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TABLE IV 
RESULTS FROM POLE PLACEMENT SEQUENCE(LQ-A) 


Q and F obtained during each reassignment 


Move 


-0.06416 
Shenk dG 42: 


MOD WO 
COr-ONM aw 
NOWN SA 
—tamn~—W—C Ory 
ATHRO DM 
Monn On 
Owyiime ea) 
! t i 
SS 
ONRAN OD 
mOOSRD AN 
AOMOW to 
mnt ~Osn 
WMNOCW Or 
OCoe-Em.. O@© 

1 1 
OONO Stan 
OINCOrd4 wtmN 
moO, oe 
Dourwst Cu 
OINSF Ors 
Now Cr 
‘ i—- teas 
COOWOSF WING 
WOVMCO ACY 
COFAMN cw 
NOS UN 
oa Md Oa 
“Oo OM... ©Oey 

oO 

’ 
a a 

(ey Fy 


NNR NC 
NMWu 3 =oOrd 
DINNER 4 
rwov19pw-—ss ert 
NMOMm OT 
COMRN SO 
AIO N 
N wy I 
NOS aS 
WOm~N0 Wr 
INMINRN OS 
too ovo 
WONMO NT 
MONE Cre 
rt ~ ' 
NMMN wre 
OoOmMmmENnm vor 
WreemEm MO 
aANAWO RO 
DINM MO 
orn ON 
ro wn ' 
MNAH ord 
WwTcown) mt 
WLU PRN 
howe COON 
MaAOonN wo 
Ooma ro 
Orner ‘ 

N 

(a en 

Cy fu 


Monm am 
W~TCODN WO 
TFIADAN ~SO 
QO Sc 
MmAOMN ~SO 
OoeonNne -©co© 
i] iat 
DONA SN 
COCONJGD fc 
AMMO Wt 
Ondo BRN 
Sco Oe 
NOoOnM wor 
rime 
Damo reo 
MHOst NWO 
commu) Ord 
NowWmM wor 
oe-7O ©O© 
eooooem oo 
\ io 
MAD rr 
mmow Or 
umcomD-+F Ot 
UNCYCOGY §=600.0 
HOstH MO 
Coon eaten) 
t 4 
~~ 
oS a 


ee 


——$—— 


——__—_— 


———_ 


—_——_ 


———_ 


2.8687 
zoo 0024 


| 


h 


u(t)= - Fx(t) + h(t), 
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TABLE V 
RESULTS FROM POLE PLACEMENT SEQUENCE(LQ-B) 


Q and F obtained during each reassignment 


Move 
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Closed loop time response for a _step input in: roll) ateae 


> Fx (tt) + h o(t), h 


u(t) 


the three designs are shown 


for 


0. Ls ads) 


in Figures 5.14 to; 5.16 


tude command ( ¢- 


It can be seen from the response 


designs have almost identical 
the 


plots that although all three 


for vaxieus 


step response 


Location: 


closed-loop pole 


The AlphaTech design's response is charac- 


States dvffers:. 


rate step 
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the yaw 


ako. 
In the Linear Quadratic Design (LQ=A), 


overshoot ' 


' 


the large 
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the yaw rate response; the yaw rate response is well damped. 
The LQ-B design appears to be a better design as coupling 
among modes are small and can not be detected from the time 
response plot. It is noted that the difference in response 
for _the..same.set— of -elosed-loop*’eigenvalue ' is due —to 
coupling among various modes through their respective eigen- 
vectors. the ¢ overshoot, im-thasycase. is obviously! not due 
to complex conjugate poles as all closed-loop poles in the 
three designs are on the real axis. The set of final eigen- 
vector for the three designs are tabulated in Table VI 

Inter-mode coupling for the yaw rate response in the 


AlphaTech design and roll attitude response in the LQ design 


case A can be readily seen from the table. The issue of 
eigenvector assignment will be discussed in the next 
section. 

TABLE VI 


CLOSED-LOOP EIGENVECTORS 


=24 79907 Sa WAZ 9.72403 =1139449 

Siena) -0.39336 =0).99976 -0.48016 -0.41854 
one 0.10767 0.00822 -0.32948 =0. 33640 
=0.-91306 O09 5.5 =O OP Lad -0.84283 

20: 500029 -0.00488 0.04306 G:.'9.3:5:9:3 

1 So LD -9.26645 = 2 «32066 “220990 
LQ-A 0: 22870 =O 715459 0.01894 =0 412653 
O218O1s =0:59821.8 0.99664 OR99I1I1S 

=0 95603 =O 00258 -0.00396 0.00031 

=0 . 03529 0.10614 0.07964 =-0 0393.2 

29 LI OIe =9).0 27,06 -12.51644 =2 2630 

LQ-B O.. E ZG 2 =0'. 13209 0.05042 =O 9977 
O99 Ets =0793557 O99 377'5 O'00797 

0.00024 “002506 0.06075 0.01945 
01:03:93.7 0.10267 0.07886 -0.00475 
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Figure 5:14 Closed-Loop Time Response Plot (AlphaTech 1). 
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Pigure 5.15 Closed-Loop Time Response Plot (LQ-A). 
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The difference in time response performance for’ the 
three designs can also be interpreted in term of the closed- 
loop pole-zero plots in the frequency domain. The pole-zero 
plots for the designs, with $e as the input, are shown in 
meeures i> .17 to 5.19 : As all pole locations are the same 
for the three designs, they are indicated only once in each 


diagram. 


inithe. Alphatech’s@design, the zero locations for the 
various channels clearly indicate the weakness in the 
design. Most transmissions zeros are located away from the 
poles locations. The system is therefore strongly coupled 
to its external environment. A _ good example is the lightly 
mampecd ‘pair of (zero at)(-1.05,+7.31j) for the v-¢.chan- 
nels. it is an fact these undesired zeros that reduce the 
overall robustness of the system. The mechanism of robust- 
ness improvement in the LQ design can also be seen in the 
Bete-zero plots in Figures 5.18 and 5.19 The “puales=in 
robustness inthe LQ design causes the zeros at various 
channels to move to locations where their transmission prop- 
erties can be canceled by the closed-loop poles. An excel- 


moc example.is-an~thev-$¢. channel, where the zeros at -2, 


wee and the mirror image of +24.0 are fairly close to the 
euesed—loop. pole locations at -2.12, -9.26 and.-25.12. lea 
the case where the zero from LQ design are not close to the 
elosed-loop poles» (r= %. channel for LQ-A ) the zeros are 
"well damped" and their transmission properties can be 
neglected. 


Robustness properties of the three designs presented 
here can also be analyzed from the open-loop’ Bode plots. 
ime open-loop transfer function gain plots for channel 1-1, 
Mees 2-1 and 2-2° for the three designs are shown in Figures 
eaeo to 5.24 Cross coupling problem for the AlphaTech 


design is clearly indicated by the relatively high gain of 
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the -channel from input<2.to-input-1--(2-1). Both LQ designs 


presented here reduced the gain in this channel by more than 


40 dB inthe frequencies of interest. The bandwidth is 
meduced from above 100 rad/s to about 8 rad/s. Unlike the 
simple (2x2) system where there was little difference 


between the direct channels of the two designs, gain adjust- 
ment is observed in all channels. For example, LQ designs 
reduce the gain in channel 1-1 but increase the gain in 
channel 2-2. Thenesis also a. siaght increase in the 
coupling channel 1-2. Thetoverall- etfect as (that of gain 
Balancing, gains in channels that are affected by cross- 
coupling perturbation are lowered together with some adjust- 
ments in other channels. Different reassignment sequence 
results in different adjustments. The designer has- to 
emoose a set of gain curve depending on the particular 
requirement. The relationship between the open-loop Bode 
plots and the zeros of the system is also evident from these 
diagrams. The low frequency resonance (or 'peak') in the 


Bain vs frequency plot for the AlphaTech design correspond 


to the undesirable zero mentioned earlier. ines the LO 
designs, these low frequency resonances are absent because 
@i the more desirable zero locations. EE 2s} also inter= 


Sacrne to note that. the LQ-B gain curves fall nicely in 
Between the other two designs. This fact, together with its 
Meeter | overall low frequency gain characteristic, may 
account for the better time response behavior of the LQ-B 


design. 


asta) tinal | cemparison, the closed-loop frequency 
response plots of the various channel for the three designs 
meee siown in) Figures 5.25 to 5.32 . At high frequency, all 
the gain plots approach the -20dB/decade slope as all eigen- 
Walues are on the real axis. The AlphaTech design has a 


near Odb gain for frequency up to about 2 rad/s. It appears 
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to be an acceptable design but was shown to have undesired 
transmission zeros in other channels; this can also be seen 
from the closed-loop plot forthe gate channel in Figure 
5.31 . Design LQ-A, obtained from the reassignment sequence 
A, is characterized by very low DC gain (-9dB) and “peak (am 
frequencies near 10 rad/s. These have been shown, both in 
the time response and pole-zero discussions that it will 
have undesired effect on the pilot's control. Design LQ-B, 
obtained from the second reassignment sequence appears to be 
the best compromise. All channels (Figures 5:30 (to Seavey 
have flat low frequency characteristic and coupling between 


modes are almost absent. 


C. DISCUSSION AND CONCLUDING REMARKS 


A new computer aided design procedure for the multivari- 
able linear time-invariant system using Linear Quadratic 
Pole Placement formulation is presented. The two design 
examples presented above have served to demonstrate the 
complexity involved ina multivariable design. The main 
problem lies in the fact that the solution of a MIMO problem 
is in general non-unique. This was shown in the helicopter 
problem where different approaches result in different 
designs, although the closed-loop eigenvalues for all 
designs were the same. It was also shown that the extra 
degrees of freedom in MIMO system design can be accounted 
for by analyzing the singular value plots, transmission zZexe 
movements and closed-loop eigenvectors of the designs. Et 
becomes apparent that the success of any multivariable 
design methodology hinges on how to make use of these extra 
degrees of freedom available in MIMO system. It was also 
shown in the above design examples that the Linear Quadratic 
Pole Placement procedures possess such quality. Some unique 


properties of the method presented here are as follows; 
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Figure 5.24 Closed-Loop Bode Plot- AlphaTech 1-1. 
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Closed-Loop Bode Plot- AlphaTech 1-3. 
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Figure 5.26 Closed-Loop Bode Plot- AlphaTech 1-4. 
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Figure 5.27 Closed-Loop Bode Plot- LQ-A 1-1. 
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Bigure, 5.28 Closed-Loop Bode, Plot- LQ-A 1-3. 
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Figure? 5/29 Closed-Loop Bode Plot- LQ-A 1-4. 
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Figure 5.30 Closed-Loop Bode Plot- LQ-B l1-l. 
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Figure, 5.31) Closed-Loop Bode Plot= LQ-B IL-3; 
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Eigure 5.32 
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Closed-Loop Bode Plot- LQ-B 1-4. 


9.1. 


ig 


l. It guarantees stability automatically. 

It has partly overcome the main difficulty Sim 
applying optimal control theory to practical prob- 
lems; i.e. that of selecting suitable performance 
indices (Q and R matrices). The designer can now 
choose to compute Q (if he knows somethings about R) 
or vice versa or compute both Q and R if both of them 
are unknown. 

3. It has built-in robustness to model's error @iae 
perturbation. 

4. Reduced-order type of problem formulation is possible 
as the procedure can reassign poles one at a time 
without affecting others. 

On the other hand, the design procedure developed here 
is not without some shortcomings. Three main problem areas 
are described below, one of which can be overcome by addi- 
tional programming efforts while the others are still active 
research areas pursued by many researchers. 

1. Eigenvectors Assignments: It was shown in the design 
examples presented above that while the overall speed 
of response of the closed-loop system is determined 
by its eigenvalues, the 'shape' of the transient 
response depends on the closed-loop eigenvectors. 


The problem of eigenvectors asSignments was first 


formulated in [Ref. 16]: Since then many eigenvec- 
tors assignment algorithms have been developed 
[Refs. 17,24] for use in multivariable designe In 


principle, the eigenvectors assignment routine can be 
incorporated into the coordinate transformation 
portion of the OPTPP program (as indicated in Figure 
4.l-in- Chapter 4). In essence, a new similarvey 
transformation different from M in Equation 4.6 is 
computed once the eigenvalues and eigenvectors are 


specified. As most eigenvector algorithms available 
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at present are iterative in nature and their inclu- 
sion requires major programing efforts, it is recom- 
manded for future work. 

Perturbation or Model”s, Error, Structure: The guaran- 
beed robustness obtained from the _ LO. formulation 
given by equations 3.4 and 3.5 ensures that’ the 
Peceurbation or models error (L(jw)), us sufficiently. 
small so that the closed-loop system remains stable. 
However, the above only applies to simple model's 
error structure where both L(jw) and R are diagonal 
matrices. There may be cases when the above equa- 
tions do not hold and hence the design becomes very 
conservative. An example of this nature is shown in 
[Ref. 19]. An ad hoc solution is to use non-diagonal 
control weighting matrix as mentioned in Chapter 4. 
Two designs for the helicopter problem are obtained 
using mnon-diagonal R. Their results in terms .of 
sampular value plots, Bode plots etc ,are compared 
with other designs in Appendix A 

Reassignment Sequence: As shown in the last section, 
different reassignment sequences result in different 
designs. At present there are no known methods for 


determining the best reassignment Sequences. 
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VI. CONCLUSIONS 


It was demonstrated that the general pole assignment 
problem in multivariable state feedback control) ‘system 
design can be formulated using the Linear Quadratic Control 
approach. This method of formulation is effective for two 
main reasons; First, the extra degrees of freedom available 
in a multivariable system structure is utilized to produce 
designs that are robust to perturbations in the system and 
gain matrices. Secondly, the classical difficulty iia 
selecting suitable performance index in optimal control 
formulation was partly overcome, as designers now have the 
flexibility of specifying only Q (the state ‘weigheume 
matrix) or R (the control weighting matrix) or both Q andar 
as the design parameters to be varied. In other wordse 
knowledge of the performance index which ideally should come 
from physical argument is used to the best of designer's 
advantage. In addition, the structure of the present formu- 
lation is such that eigenvector assignment can be further 
incorporated into the procedure. The above properties, when 
combined with the reduced-order formulation capability, have 
been shown to be very versatile and have important impact on 
the performance of the resulting design. 

The optimal pole placement (OPTPP) program developed 
here is combined with other well established routines to 
form a computer aided design and synthesis package. 
Together with the design procedure and philosophy presented 
here, it provides the control system designer an excellent 
and viable tool to solve complex multivariable problems. 

The procedure was applied to practical test examples, 
and numerical results were presented and discussed. Results 


indicated that all controllers obtained from’ the tommulatwonm 
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given here were stable and robust. Introducing perturbation 
in the system matrices leaded only to small errors in the 
assigned poles. The main shortcoming of the design proce- 
dure is the ad hoc nature in which the poles are reassigned. 
More research is required to develop a systematic way of 
assigning poles and its eigenvectors thus allowing the 


designer to optimaly shape the response of the system. 
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APPENDIX A 
NON-DIAGONAL R DESIGNS 


The two design examples presented in Chapter 5 were 
based on diagonal control wetghting*matrix (ives R= oe BE 
is now illustrated that design using non-diagonal R will 
provide yet another degrees of freedom available to the 
designer. This type of formulation is especially user 
when the model's or error structure is known. For mulespie 
cative type of perturbation, the effect of control weighting 
matrix on the system stabidovtry has been explored in 
[Ref. 12]. In essence, the selection of the R matrix deter. 


mines the coordinate frame in which the sensitivity assess- 


ment is to be made. This can be readily seen from equation 
3.1, the general form in which R is non-diagonal is *erveg 
below; 

2 (2 ~1 ~4/2 

oo ER x “GS.)R - ££] <= © [roe Ces (eqn A.1) 


In general, the sensitivity of the system to perturba- 
tion ina particular L(s)'s direction can be reduced time 
making o PRE sR =\«/2)] 1 osmailie This ‘can be “done 
simply by choosing an appropriate R. The main problem with 
this kind of approach is that L(s) must be known precisly 


for all frequency for the computation of =: fr" Legs) ee 


te In addition, the worst case direction of [I (s') “mustepe 
known otherwise the resulting design may be too 
conservative. 


The helicopter problem presented in Chapter 5 is now 
analyzed using the non-diagonal control weighting matrix. 


Two designs are obtained as follows; 
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Design one (LQ-C): 


Design LQ-C is obtained uSing an assignment Sequence 
Similar to LQ-A with no off-diagonal element in R. Design 
LQ-D is obtained using placement sequence for design LQ-B 
but has off-diagonal element in R. Q and F- obtained during 
each move and the final Q, and F, are tabulated in Tables 
VII and VIII. Singular value plots and the open-loop Bode 
Plots are compared with other designs in Figures A.1l to A.5 

Both design has singular value greater than one for all 
meequency.’ Iti/is interesting to note that similar reassign- 
ment Sequence produce similar singular value plots. This 
can be readily seen by comparing LQ-A with LQ-C and LQ-B 
wath LQ-D. in the figures. The effect of using non-diagonal 
R merely changes the shape of the singular value plots. For 
the cases presented here, both non-diagonal R_ designs are 
slightly less conservative (having lower singular value). 

asain. the -singular value -plots, the shape of the open- 
loop Bode plots (with feedback) are closely related to the 
reassignment sequence.(compare Bode plots of LQ-A with LQ-C 
MemGo-B wWwith-LO-D.in Figures A.2 to As5 . Results from 
pole-zero maps also indicate similar trends. 

in summary, it is demonstrated that designs using non- 
diagonal control weighting matrix (including possibly off- 


diagonal elements) provide yet another means of ‘fine 


Di; 


tuning' the design. This capability, such as using the off- 
diagonal elements directly in design, is unique! to "tme 
present formulation. Robustness between the upper and lower 
crossfeed (of L(s)) can be controlled by adjusting the retae 
tive weighting of the upper and lower (or off-diagonal ) 
elements of the control weighting matrix. It must be empha- 
sized that this kind of fine tuning is only possible) fame 
class of rather well-defined structure of L. In practicese 
other constraints, such as the energy of the control inpaee 
the conditioning of R etc must’ be considered over the range 
of frequencies. The key issue of model's error structure 
and how it can be used in multivariable control system 


design is currently being investigated by many researchers. 
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TABLE VII 
RESULTS FROM POLE PLACEMENT SEQUENCE (LQ-C) 


Q and F obtained during each reassignment 
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TABLE VIII 
RESULTS FROM POLE PLACEMENT SEQUENCE "(L0—)) 


Q and F obtained during each reassignment 
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Figure A.l Singular Value Plots - Comparison. 
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Figure A.2 Bode Plots Comparison- Input 1-1. 
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Figure A.3 Bode Rilets Comparison - Input 1-2. 
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EXAMPLE DESIGN RUN OUTPUTS 
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